- Background in social work and health data management.
- MPH student.
- Data Science Fellow, D-lab.
Summer 2021
About me:
Overview: some questions
- What is open defecation?
- How did I wind up studying this?
- Why am I showing it to you?
What is open defecation?
The World Health Organization describes open defecation as, “when human faeces are disposed of in the fields, forests, bushes, open bodies of water, beaches, and other open spaces.”
This case study explores mapping and surveillance of open defecation in urban areas, namely San Francisco, Ca.
What is open defecation?
It’s estimated that in 2017 to 2019, up to 460,000 individuals lacked access to basic water and sanitation services in the urban United States." (Capone, Ferguson, Gribble, et al, 2020)
Universal access to sanitation systems in the urban United States seems like a 19th century problem, but it’s an ongoing public health crisis we grapple with in 2021.
Open defecation events occur, and are symptoms of deeply rooted social inequities around chronic homelessness and lack of affordable housing in the United States.
How did I wind up studying this?
I had some experience aggregating 311 reports around tent communities to support regional street medicine outreach in Alameda county.
In early spring of 2020, I was viewing a lecture in an Environmental Health Sciences course and I heard a professor discuss open defectation and sanitary intervention strategies in San Francisco.
I recalled that 311 reports in the San Francisco Open Data Portal included a “Human & Animal Waste” category with geospatial coordinates available.
I outreached the professor with some code I put together on my own and he was very impressed. We decided I could make a research project out of it.
How did I wind up studying this?
I got underway just as COVID-19 began to roll into the United States.
At that time there were concerns around, "human feces as a potential vector of SARS-COV2 transimision. (Xiao & Teng, et al. 2020)
I have not heard of SARS-CoV2 traveling through the fecal-oral route as an empircal issue so far.
How did I wind up studying this?
- While the urgency around COVID-19 came and left, I still beleived that public health surviellance of open defecation events was an interesting and worthwhile research project.
Why am I showing it to you?
This case study is an excellent example of how to use large, timely, and readily available data sources to explore serious questions about the health of an urban area.
The methods I go over are generalizable to crowdsourced data collected through 311, and could be applied to other events.
311 data can be misleading: I outline a few methods and approaches that work to support data quality when working with crowdsourced like these.
Disclamer:
I’ll be going over a fair amount of
Rcode and some interactive maps in this presentation.This was a methods focused project, but I hope to focus more on maps and visualizations today, interpreting results.
I’ll be sharing some links at the end of the presentation with all the code and access to materials I used to put this together.
Importing and cleaning 311 data:
San Francisco Open Data Portal
report_data <-
read.socrata("https://data.sfgov.org/resource/vw6y-z8j6.json",
stringsAsFactors = FALSE)
Importing and cleaning 311 data:
hum_anim_waste <- report_data %>%
filter(str_detect(request_type, "Waste") &
request_type != "Medical Waste") %>%
mutate(opened = as.character(opened)) %>%
mutate(opened = str_remove(opened, "(\\d+:\\d+:\\d+\\s\\w+)")) %>%
mutate(opened = as.character.Date(opened)) %>%
mutate(opened = lubridate::mdy(opened)) %>%
filter(latitude> 37) %>%
filter(longitude != 'NA'| latitude!= 'NA') %>%
filter(responsible_agency != "Duplicate" &
responsible_agency != "Animal Care") %>%
mutate(latitude= as.numeric(latitude)) %>%
mutate(longitude = as.numeric(longitude))
Using narrative cues to filter out non-events:
Tradtional data cleaning tasks are only a first step.
Most 311 data I’ve encountered contain all the reports that people file, even false alarms.
There can be a lot of “unreliable observations” in the rows of the data itself.
Using narrative cues to filter out non-events:
I used narrative cues from a
status_reportsvariable to filter out as many non-events as I could.The
status_reportsare text data, sort of like case notes the DPW staff complete after responding to a call.
Using narrative cues to filter out non-events:
nar_cues <- c("Duplicate","nothing", "Nothing", "Case Transferred",
"Insufficient Information","gone", "no work needed ",
"Unable to locate", "animal control", "not thing",
"does not match", "not see any", "Unable to Locate",
"Case is Invalid", "noting", "see anything",
"dont see any",
"Not thing", "not at", "no poop", "see this",
"wasnt there","looked both", "Duplicate",
"Animal Care",
"no feces", "Unable To Locate", "not locate feces",
"No feces", "insufficient information",
"does not exist",
"didnt see any", "nothng", "WASTE NOT FOUND",
"not sure where",
"there is not", "did not find", "DUPLICATE",
"already removed", "No encampments", "nohing here",
"Cancelled", "dup", "duplicate", "incomplete",
"no human waste", "no bird found", "in progress",
"no dead rat", "no human feces","invalid address",
"no debris in the area", "NOTHING FOUND",
"TRANS TO RECO",
"Cancel per 311", "not remove homeless",
"INCORRECT CATEGORY", "Location not entered",
"No human waste found", "NO HUMAN WASTE", "not there",
"no items visable", "GRAFFITI", "graffiti",
"didnt see piles", "recology", "Recology",
"theres birds", "no encampment",
"this stuff", "Animal Care", "nothin here", "debris",
"thats garbage", "does not have any feces",
"loose garbage","rat removed", "no waste back",
"NOTHING BUT TRASH", "unable to find", "not find any",
"nor did i see", "any feces", "and nothim",
"couldn't find", "could not find", "wrong address",
"Abandon Vehicles", "ntohing found", "no poo",
"vomit", "no pile of poo", "personal belonging",
"claimed", "needles", "cant locate", "Trash",
"dog poop", "trash",
"items", "glass", "Dup", "nothing", "uable to locate")
Using Narrative Cues to filter out non-events:
- Locating narrative cues is never exhaustive.
- Removing all the “false positive” observations is fairly simple.
- I eventually got it down to four lines of code.
hum_anim_waste_clean <-
hum_anim_waste %>%
filter(!(str_detect(status_notes,
paste(nar_cues, collapse = "|"))))
Mapping:
- Here are all the (filtered) Human & Animal Waste Reports from the month of January, 2020.
qtm(map_jan_calls, dots.col = "red", symbols.size = .002)
Approaches to Data Quality, Distinct vs. Duplicated:
- There are two functional ways to cut through the noise a bit.
distinct()is a function that “flattens” all the reportsduplicated()is a function that “stacks” reports on an identical coordinate.- Let’s look at both.
Approaches to Data Quality, Distinct:
jan_distinct_calls = jan_calls %>%
distinct(address, .keep_all = TRUE) %>%
distinct(latitude, .keep_all = TRUE) %>%
distinct(longitude, .keep_all = TRUE)
# what percentage of calls have we removed via distinct?
round((nrow(jan_calls) -
nrow(jan_distinct_calls)) / nrow(jan_calls),2)
## [1] 0.15
Approaches to Data Quality, Distinct:
distinct()does not seem to do all that much, but it has its uses.
Approaches to Data Quality, Duplicated:
- With
duplicated()here, I’m only looking at event that happened at the same place, more than once.
dupl_lat <- duplicated(jan_calls$latitude)
lat_select <- jan_calls[dupl_lat, ]
dupl_longitude <- duplicated(lat_select$longitude)
jan_dupl_calls <- lat_select[dupl_longitude, ]
# what percentage of calls have we removed via duplicated?
round((nrow(jan_calls) -
nrow(jan_dupl_calls)) / nrow(jan_calls),4)
## [1] 0.9956
Approaches to Data Quality, Duplicated:
- Almost all the points are gone from this January 2020 timeframe.
Approaches to Data Quality, Duplicated:
- Notice how the
duplicated()changes over 3 & 6 month intervals?
Systemic Bias:
- Observations from 311 are more social, than scientific.
- For us, they are observations of observations.
- Differences in participation can distort what we see and don’t see.
Participation Bias:
- What can we make of this scatterplot of aggregate 311 reports from 2019-2020?
Participation Bias:
Reporting changes, system updates, and trends over time can bring up a host of interesting data quality challenges.
Certain areas, communities, individuals, and populations may not participate in 311 reporting at all.
It is possible to identify and chacterize users on a system administrator level, but external researchers have only the event reports themselves to work from.
Overreporting can be adjusted for here and there, underreporting in certain areas is the biggest data quality challenge.
Statistical Analysis:
- There are a few more complicated processes we can apply to these 311 data.
- Let’s go over two of them now.
- Density Plotting with the
distinct()data structure. - Positive Spatial Autocorrelation (PSA) with the
duplicated()structure.
## OGR data source with driver: ESRI Shapefile ## Source: "/Users/avery/Desktop/Practicum/Analysis Neighborhoods", layer: "geo_export_dfbc5470-1876-41c8-90fb-f3d80661c272" ## with 195 features ## It has 5 fields
Statistical Analysis: Density Plotting
jan_waste_spdf <- sp::SpatialPointsDataFrame(coords =
jan_distinct_calls[,c("longitude", "latitude")],
data = jan_distinct_calls[,c("neighborhood")],
proj4string = CRS("+init=epsg:4326"))
sf_owin <- owin(xrange=range(jan_distinct_calls$longitude),
yrange=range(jan_distinct_calls$latitude))
sf_ppp <- ppp(jan_distinct_calls$longitude,
jan_distinct_calls$latitude,
window = sf_owin)
density_raster <-
raster(density(sf_ppp, bw.ppl), crs = crs(sf_nhoods))
Statistical Analysis: Density Plotting
- Using that
distinct()approach, we can create density plots. - Density plots can help us evaluate the intensity of events on a highly visual level.
Statistical Analysis: Density Plotting
- Density plots can help us make sense of large collections of spatial points.
Statistical Analysis: LISA
We can look at positive spatial autocorrelation (PSA) with the
duplicated()event data.PSA can be descirbed as, "the tendency for areas or sites that are close together to have similar values.’
Global Moran’s I test looks for evidence of PSA in all the data together.
Local Indicators of Spatial Autocorrelation (LISAs) use a Moran’s I framework to artuculate how each coordinate value itself reveals an indication of the extent of spatial clustering of similar proximal values.
Let’s look at a global Moran’s I, and then a mapped LISA.
Statistical Analysis: LISA
- We need to elaborate on the
duplicated()approach to include “value” event column.
year_waste <- hum_anim_waste %>%
filter(opened >= "2020-01-01" &
opened < "2021-01-01")
dup_waste <- year_waste %>%
dplyr::select(opened, latitude, longitude) %>%
group_by(latitude, longitude) %>%
mutate(events = n()) %>%
filter(events > 1) %>%
distinct(latitude, .keep_all = T) %>%
distinct(longitude, .keep_all = T)
Statistical Analysis: LISA
head(dup_waste)
## # A tibble: 6 x 4 ## # Groups: latitude, longitude [6] ## opened latitude longitude events ## <date> <dbl> <dbl> <int> ## 1 2020-08-26 37.8 -122. 2 ## 2 2020-08-26 37.8 -122. 2 ## 3 2020-03-03 37.8 -122. 10 ## 4 2020-08-27 37.8 -122. 2 ## 5 2020-10-10 37.8 -122. 6 ## 6 2020-07-14 37.8 -122. 3
Statistical Analysis: LISA
- This map is an abstract sort of visualization.
Statistical Analyses: Global Moran’s I
- Semivariograms can evaluate global PSA.
pgi_cor <- pgirmess::correlog(coords=xy, z=dup_waste$log_odds,
method="Moran", nbclass=10)
## Ii E.Ii Var.Ii Z.Ii Pr(z > 0) ## [1,] -0.11057522 -0.00112613 0.00253820 -2.1724 0.9850890 ## [2,] 0.11774304 -0.00112613 0.02891449 0.6991 0.2422588 ## [3,] 0.53521804 -0.00112613 0.00204105 11.8718 < 0.00000000000000022 *** ## [4,] -0.03279781 -0.00112613 0.01127880 -0.2982 0.6172332 ## [5,] 0.23813154 -0.00112613 0.00194429 5.4261 0.0000000288036781541 *** ## [6,] 0.03397467 -0.00112613 0.00263440 0.6839 0.2470274 ## [7,] -0.03938162 -0.00112613 0.01487372 -0.3137 0.6231172 ## [8,] 0.16670224 -0.00112613 0.00188904 3.8614 0.0000563687828742679 *** ## [9,] -0.17533058 -0.00112613 0.02248202 -1.1618 0.8773472 ## [10,] 0.23167343 -0.00112613 0.00209177 5.0901 0.0000001789513496476 *** ## [11,] 0.44979102 -0.00112613 0.00223164 9.5452 < 0.00000000000000022 *** ## [12,] 0.03922142 -0.00112613 0.00232397 0.8370 0.2013090 ## [13,] -0.17741062 -0.00112613 0.00921504 -1.8364 0.9668502 ## [14,] 0.50666090 -0.00112613 0.00237208 10.4260 < 0.00000000000000022 *** ## [15,] 0.47901366 -0.00112613 0.00231215 9.9853 < 0.00000000000000022 *** ## [16,] 0.09288701 -0.00112613 0.03191632 0.5262 0.2993615 ## [17,] 0.50411533 -0.00112613 0.00206114 11.1287 < 0.00000000000000022 *** ## [18,] -0.09210095 -0.00112613 0.06965349 -0.3447 0.6348426 ## [19,] -0.18254378 -0.00112613 0.02429631 -1.1639 0.8777643 ## [20,] 0.00821215 -0.00112613 0.00344033 0.1592 0.4367522 ## [21,] -0.10989978 -0.00112613 0.00238432 -2.2276 0.9870472 ## [22,] 0.06871945 -0.00112613 0.01176123 0.6440 0.2597749 ## [23,] 0.02389934 -0.00112613 0.00537080 0.3415 0.3663719 ## [24,] 0.09424652 -0.00112613 0.00348240 1.6162 0.0530298 . ## [25,] 0.22562302 -0.00112613 0.00375217 3.7017 0.0001071 *** ## [26,] 0.03329281 -0.00112613 0.00295612 0.6330 0.2633514 ## [27,] 0.22380932 -0.00112613 0.00230041 4.6898 0.0000013673021695669 *** ## [28,] -0.07803772 -0.00112613 0.00218732 -1.6445 0.9499643 ## [29,] 0.22810786 -0.00112613 0.00253820 4.5500 0.0000026816660954535 *** ## [30,] 0.57176732 -0.00112613 0.00276582 10.8934 < 0.00000000000000022 *** ## [31,] 0.18506800 -0.00112613 0.00708307 2.2124 0.0134710 * ## [32,] -0.01402465 -0.00112613 0.00634441 -0.1619 0.5643220 ## [33,] 0.31347111 -0.00112613 0.00213354 6.8109 0.0000000000048496274 *** ## [34,] -0.52517885 -0.00112613 0.49419676 -0.7455 0.7720035 ## [35,] -0.33569448 -0.00112613 0.02429631 -2.1464 0.9840803 ## [36,] -0.00377453 -0.00112613 0.00798437 -0.0296 0.5118226 ## [37,] 0.14302066 -0.00112613 0.02429631 0.9248 0.1775422 ## [38,] 0.10609554 -0.00112613 0.03085115 0.6104 0.2707834 ## [39,] -0.37700117 -0.00112613 0.02566928 -2.3460 0.9905131 ## [40,] 0.25635548 -0.00112613 0.00242156 5.2324 0.0000000836718189558 *** ## [41,] -0.02474961 -0.00112613 0.00833058 -0.2588 0.6021149 ## [42,] -0.04760027 -0.00112613 0.00348240 -0.7875 0.7845168 ## [43,] -0.11090637 -0.00112613 0.00194429 -2.4897 0.9936071 ## [44,] 0.18113503 -0.00112613 0.00806852 2.0291 0.0212255 * ## [45,] 0.03740830 -0.00112613 0.00245960 0.7770 0.2185816 ## [46,] 0.02110250 -0.00112613 0.00651629 0.2754 0.3915170 ## [47,] 0.04922136 -0.00112613 0.01597561 0.3983 0.3451914 ## [48,] 0.36630339 -0.00112613 0.49419676 0.5227 0.3006034 ## [49,] -0.51049127 -0.00112613 0.02366131 -3.3114 0.9995358 ## [50,] 0.03287708 -0.00112613 0.00314779 0.6061 0.2722369 ## [51,] 0.24855640 -0.00112613 0.00237208 5.1265 0.0000001475633424409 *** ## [52,] 0.01396592 -0.00112613 0.00493653 0.2148 0.4149611 ## [53,] 0.30124748 -0.00112613 0.00232397 6.2723 0.0000000001778459437 *** ## [54,] 0.02161919 -0.00112613 0.00413756 0.3536 0.3618170 ## [55,] -0.01632211 -0.00112613 0.02429631 -0.0975 0.5388312 ## [56,] 0.04076544 -0.00112613 0.00235992 0.8623 0.1942507 ## [57,] -0.15534999 -0.00112613 0.02496473 -0.9761 0.8354891 ## [58,] -0.00625509 -0.00112613 0.00335845 -0.0885 0.5352617 ## [59,] -0.01050556 -0.00112613 0.00541340 -0.1275 0.5507197 ## [60,] 0.38179627 -0.00112613 0.00226567 8.0447 0.0000000000000004321 *** ## [61,] 0.02689032 -0.00112613 0.00333844 0.4849 0.3138780 ## [62,] 0.17672988 -0.00112613 0.00377609 2.8943 0.0018999 ** ## [63,] -0.28354143 -0.00112613 0.00978201 -2.8554 0.9978512 ## [64,] 0.02864239 -0.00112613 0.00207129 0.6541 0.2565271 ## [65,] -0.30699481 -0.00112613 0.04392360 -1.4594 0.9277779 ## [66,] 0.06638427 -0.00112613 0.02429631 0.4331 0.3324666 ## [67,] -0.10010181 -0.00112613 0.00238432 -2.0270 0.9786671 ## [68,] 0.06234132 -0.00112613 0.00563507 0.8455 0.1989224 ## [69,] -0.04478021 -0.00112613 0.01513564 -0.3548 0.6386428 ## [70,] 0.21302551 -0.00112613 0.02891449 1.2594 0.1039430 ## [71,] 0.03332752 -0.00112613 0.00218732 0.7367 0.2306583 ## [72,] 0.06638427 -0.00112613 0.02429631 0.4331 0.3324666 ## [73,] -0.10426155 -0.00112613 0.00247246 -2.0742 0.9809680 ## [74,] -0.31254631 -0.00112613 0.02366131 -2.0245 0.9785429 ## [75,] 0.03564024 -0.00112613 0.00237208 0.7549 0.2251561 ## [76,] 0.04074030 -0.00112613 0.00237208 0.8596 0.1950020 ## [77,] 0.21610045 -0.00112613 0.00287460 4.0516 0.0000254367609843498 *** ## [78,] -0.08634194 -0.00112613 0.00295612 -1.5673 0.9414805 ## [79,] -0.10455125 -0.00112613 0.00339902 -1.7740 0.9619670 ## [80,] -0.05732003 -0.00112613 0.00550029 -0.7577 0.7756842 ## [81,] 0.11866329 -0.00112613 0.00634441 1.5039 0.0663019 . ## [82,] -0.09676081 -0.00112613 0.00255164 -1.8932 0.9708371 ## [83,] -0.01892437 -0.00112613 0.03427489 -0.0961 0.5382940 ## [84,] 0.03405521 -0.00112613 0.02305728 0.2317 0.4083892 ## [85,] 0.02072729 -0.00112613 0.01083124 0.2100 0.4168412 ## [86,] -0.02806912 -0.00112613 0.00782062 -0.3047 0.6196901 ## [87,] -0.09782730 -0.00112613 0.00297283 -1.7736 0.9619323 ## [88,] -0.03572006 -0.00112613 0.00486376 -0.4960 0.6900658 ## [89,] -0.13481899 -0.00112613 0.00213354 -2.8944 0.9981005 ## [90,] 0.03047019 -0.00112613 0.00541340 0.4294 0.3338019 ## [91,] 0.41431290 -0.00112613 0.00220933 8.8385 < 0.00000000000000022 *** ## [92,] 0.16055784 -0.00112613 0.01911263 1.1695 0.1210976 ## [93,] 0.10866684 -0.00112613 0.00214416 2.3711 0.0088681 ** ## [94,] 0.17262033 -0.00112613 0.00227718 3.6410 0.0001358 *** ## [95,] 0.13509473 -0.00112613 0.00682109 1.6494 0.0495365 * ## [96,] 0.02946545 -0.00112613 0.00524629 0.4224 0.3363836 ## [97,] -0.09429307 -0.00112613 0.00281170 -1.7570 0.9605429 ## [98,] 0.03565458 -0.00112613 0.00243414 0.7455 0.2279852 ## [99,] 0.23811371 -0.00112613 0.00200162 5.3474 0.0000000446121864624 *** ## [100,] 0.03798207 -0.00112613 0.00244683 0.7906 0.2145837 ## [101,] 0.02434676 -0.00112613 0.02641298 0.1567 0.4377263 ## [102,] -0.03299465 -0.00112613 0.00486376 -0.4570 0.6761492 ## [103,] 0.04196588 -0.00112613 0.02248202 0.2874 0.3869050 ## [104,] -0.09602126 -0.00112613 0.00228875 -1.9836 0.9763473 ## [105,] 0.26519638 -0.00112613 0.09795638 0.8509 0.1974054 ## [106,] 0.12250573 -0.00112613 0.00359108 2.0631 0.0195520 * ## [107,] 0.04783155 -0.00112613 0.00234786 1.0104 0.1561565 ## [108,] -0.13923164 -0.00112613 0.32909660 -0.2407 0.5951219 ## [109,] -0.08027877 -0.00112613 0.00292312 -1.4640 0.9284036 ## [110,] -0.09425666 -0.00112613 0.01487372 -0.7636 0.7774558 ## [111,] 0.02103054 -0.00112613 0.00657536 0.2732 0.3923343 ## [112,] 0.03927249 -0.00112613 0.02429631 0.2592 0.3977494 ## [113,] 0.14398721 -0.00112613 0.07509636 0.5295 0.2982158 ## [114,] 0.13920331 -0.00112613 0.00422210 2.1597 0.0153996 * ## [115,] 0.25734092 -0.00112613 0.02891449 1.5200 0.0642538 . ## [116,] -0.11606923 -0.00112613 0.00269169 -2.2155 0.9866369 ## [117,] -0.02942956 -0.00112613 0.00316612 -0.5030 0.6925210 ## [118,] 0.19662463 -0.00112613 0.00238432 4.0498 0.0000256279812562614 *** ## [119,] -0.10112146 -0.00112613 0.00361343 -1.6635 0.9518927 ## [120,] 0.22516692 -0.00112613 0.00231215 4.7061 0.0000012623644652533 *** ## [121,] 0.02238653 -0.00112613 0.00472335 0.3421 0.3661308 ## [122,] -0.07791348 -0.00112613 0.00520584 -1.0643 0.8563925 ## [123,] 0.23581337 -0.00112613 0.00305847 4.2844 0.0000091636412561734 *** ## [124,] -0.11911274 -0.00112613 0.00300666 -2.1517 0.9842912 ## [125,] 0.02296699 -0.00112613 0.00462230 0.3544 0.3615287 ## [126,] -0.06370037 -0.00112613 0.08144636 -0.2193 0.5867763 ## [127,] -0.06370037 -0.00112613 0.08144636 -0.2193 0.5867763 ## [128,] -0.15204269 -0.00112613 0.01265463 -1.3416 0.9101317 ## [129,] 0.13150766 -0.00112613 0.00247246 2.6674 0.0038219 ** ## [130,] -0.13797861 -0.00112613 0.02566928 -0.8542 0.8034954 ## [131,] 0.03047120 -0.00112613 0.00701596 0.3772 0.3530012 ## [132,] 0.13845640 -0.00112613 0.02641298 0.8589 0.1952089 ## [133,] -0.08540465 -0.00112613 0.00220933 -1.7930 0.9635156 ## [134,] -0.01609418 -0.00112613 0.00628883 -0.1887 0.5748545 ## [135,] -0.09706895 -0.00112613 0.00281170 -1.8094 0.9648033 ## [136,] -0.00261780 -0.00112613 0.00344033 -0.0254 0.5101447 ## [137,] 0.22417730 -0.00112613 0.00348240 3.8179 0.0000672867983297604 *** ## [138,] 0.21911415 -0.00112613 0.03852032 1.1222 0.1308989 ## [139,] 0.32657110 -0.00112613 0.00253820 6.5044 0.0000000000389917998 *** ## [140,] -0.08200373 -0.00112613 0.00215484 -1.7423 0.9592712 ## [141,] -0.73443493 -0.00112613 0.02366131 -4.7672 0.9999991 ## [142,] -0.02901204 -0.00112613 0.01015311 -0.2767 0.6090134 ## [143,] 0.24544628 -0.00112613 0.00228875 5.1540 0.0000001274895130712 *** ## [144,] 0.36630339 -0.00112613 0.98949724 0.3694 0.3559244 ## [145,] -0.00552832 -0.00112613 0.00489993 -0.0629 0.5250725 ## [146,] -0.00736432 -0.00112613 0.00824158 -0.0687 0.5273919 ## [147,] 0.06984209 -0.00112613 0.01953380 0.5078 0.3058059 ## [148,] -0.09476695 -0.00112613 0.00335845 -1.6158 0.9469345 ## [149,] -0.11069407 -0.00112613 0.02305728 -0.7216 0.7647210 ## [150,] -0.10661643 -0.00112613 0.00262035 -2.0608 0.9803383 ## [151,] 0.07451484 -0.00112613 0.00486376 1.0846 0.1390487 ## [152,] -0.15024616 -0.00112613 0.00890236 -1.5805 0.9429992 ## [153,] 0.67252414 -0.00112613 0.00278099 12.7742 < 0.00000000000000022 *** ## [154,] -0.04042118 -0.00112613 0.00395037 -0.6252 0.7340801 ## [155,] 0.11978643 -0.00112613 0.00222045 2.5660 0.0051444 ** ## [156,] -0.02953974 -0.00112613 0.00640084 -0.3551 0.6387602 ## [157,] -0.04669935 -0.00112613 0.00628883 -0.5747 0.7172456 ## [158,] -0.03358680 -0.00112613 0.00554461 -0.4359 0.6685581 ## [159,] -0.08460308 -0.00112613 0.00214416 -1.8028 0.9642872 ## [160,] 0.02420612 -0.00112613 0.00675820 0.3081 0.3789851 ## [161,] 0.13848302 -0.00112613 0.00207129 3.0676 0.0010791 ** ## [162,] -0.00383055 -0.00112613 0.00806852 -0.0301 0.5120094 ## [163,] 0.12945016 -0.00112613 0.00242156 2.6535 0.0039832 ** ## [164,] -0.08113522 -0.00112613 0.00279629 -1.5130 0.9348644 ## [165,] -0.11377619 -0.00112613 0.00260640 -2.2065 0.9863267 ## [166,] 0.01288880 -0.00112613 0.00493653 0.1995 0.4209472 ## [167,] 0.00725429 -0.00112613 0.00890236 0.0888 0.4646123 ## [168,] -0.06757172 -0.00112613 0.05392967 -0.2861 0.6126079 ## [169,] -0.12384082 -0.00112613 0.00191641 -2.8032 0.9974700 ## [170,] 0.11725057 -0.00112613 0.10896306 0.3586 0.3599421 ## [171,] -0.08540585 -0.00112613 0.00815424 -0.9333 0.8246731 ## [172,] 0.14618265 -0.00112613 0.00260640 2.8854 0.0019545 ** ## [173,] -0.05891181 -0.00112613 0.00462230 -0.8499 0.8023223 ## [174,] 0.12126405 -0.00112613 0.00377609 1.9917 0.0232017 * ## [175,] -0.04900406 -0.00112613 0.00572802 -0.6326 0.7365045 ## [176,] 0.18424795 -0.00112613 0.00222045 3.9339 0.0000417808920435151 *** ## [177,] 0.04929349 -0.00112613 0.00395037 0.8022 0.2112197 ## [178,] 0.16622196 -0.00112613 0.00213354 3.6230 0.0001456 *** ## [179,] 0.15345560 -0.00112613 0.00304106 2.8031 0.0025303 ** ## [180,] -0.10819478 -0.00112613 0.00238432 -2.1927 0.9858357 ## [181,] -0.08123362 -0.00112613 0.00197269 -1.8036 0.9643543 ## [182,] -0.03892196 -0.00112613 0.00634441 -0.4745 0.6824330 ## [183,] 0.33907884 -0.00112613 0.02429631 2.1826 0.0145333 * ## [184,] -0.00141951 -0.00112613 0.00352526 -0.0049 0.5019713 ## [185,] 0.02670871 -0.00112613 0.00333844 0.4817 0.3149937 ## [186,] -0.04721763 -0.00112613 0.00375217 -0.7525 0.7741107 ## [187,] 0.06629271 -0.00112613 0.01246616 0.6038 0.2729782 ## [188,] 0.09885634 -0.00112613 0.03852032 0.5094 0.3052277 ## [189,] 0.14656446 -0.00112613 0.00311161 2.6476 0.0040527 ** ## [190,] -0.01228169 -0.00112613 0.01083124 -0.1072 0.5426807 ## [191,] -0.04425804 -0.00112613 0.00663535 -0.5295 0.7017710 ## [192,] -0.01034866 -0.00112613 0.01083124 -0.0886 0.5353064 ## [193,] -0.00141311 -0.00112613 0.02429631 -0.0018 0.5007345 ## [194,] -0.10904953 -0.00112613 0.00249847 -2.1591 0.9845799 ## [195,] 0.03480670 -0.00112613 0.00218732 0.7683 0.2211520 ## [196,] 0.15145628 -0.00112613 0.00253820 3.0286 0.0012285 ** ## [197,] 0.02376798 -0.00112613 0.00978201 0.2517 0.4006366 ## [198,] 0.08291268 -0.00112613 0.01193051 0.7694 0.2208289 ## [199,] 0.03656559 -0.00112613 0.00275076 0.7187 0.2361773 ## [200,] 0.09288701 -0.00112613 0.03191632 0.5262 0.2993615 ## [201,] 0.20162662 -0.00112613 0.00214416 4.3786 0.0000059713099219625 *** ## [202,] 0.03510337 -0.00112613 0.00222045 0.7689 0.2209910 ## [203,] 0.03399387 -0.00112613 0.00337864 0.6042 0.2728541 ## [204,] 0.01431921 -0.00112613 0.02429631 0.0991 0.4605336 ## [205,] 0.05844249 -0.00112613 0.00582356 0.7806 0.2175218 ## [206,] 0.03183609 -0.00112613 0.00220933 0.7013 0.2415669 ## [207,] 0.02925781 -0.00112613 0.01015311 0.3015 0.3815015 ## [208,] 0.24964146 -0.00112613 0.03699632 1.3037 0.0961605 . ## [209,] 0.13633883 -0.00112613 0.00234786 2.8370 0.0022771 ** ## [210,] 0.02574900 -0.00112613 0.02366131 0.1747 0.4306516 ## [211,] -0.11821029 -0.00112613 0.00292312 -2.1656 0.9848285 ## [212,] -0.09737741 -0.00112613 0.00307603 -1.7354 0.9586690 ## [213,] -0.11629145 -0.00112613 0.00259256 -2.2618 0.9881457 ## [214,] -0.05247242 -0.00112613 0.01462011 -0.4247 0.6644550 ## [215,] -0.04328347 -0.00112613 0.00326017 -0.7383 0.7698445 ## [216,] 0.37360688 -0.00112613 0.00206114 8.2541 < 0.00000000000000022 *** ## [217,] 0.04954952 -0.00112613 0.00682109 0.6136 0.2697459 ## [218,] 0.03163965 -0.00112613 0.03558521 0.1737 0.4310528 ## [219,] 0.03896498 -0.00112613 0.00446146 0.6002 0.2741802 ## [220,] 0.12139819 -0.00112613 0.00194429 2.7787 0.0027288 ** ## [221,] 0.01064598 -0.00112613 0.00365879 0.1946 0.4228456 ## [222,] 0.03026283 -0.00112613 0.00289064 0.5838 0.2796704 ## [223,] -0.11100113 -0.00112613 0.01228278 -0.9914 0.8392557 ## [224,] -0.10557580 -0.00112613 0.00251162 -2.0842 0.9814271 ## [225,] 0.05633336 -0.00112613 0.00890236 0.6090 0.2712659 ## [226,] 0.07525719 -0.00112613 0.00921504 0.7957 0.2131030 ## [227,] -0.03234352 -0.00112613 0.01346394 -0.2690 0.6060490 ## [228,] -0.06370037 -0.00112613 0.08144636 -0.2193 0.5867763 ## [229,] -0.02882184 -0.00112613 0.00377609 -0.4507 0.6738985 ## [230,] -0.07469351 -0.00112613 0.00520584 -1.0196 0.8460464 ## [231,] 0.66033461 -0.00112613 0.00202121 14.7129 < 0.00000000000000022 *** ## [232,] 0.07043136 -0.00112613 0.02566928 0.4466 0.3275710 ## [233,] -0.13105749 -0.00112613 0.00219829 -2.7712 0.9972077 ## [234,] -0.50199549 -0.00112613 0.01159630 -4.6512 0.9999983 ## [235,] 0.11505196 -0.00112613 0.00222045 2.4655 0.0068412 ** ## [236,] -0.07905596 -0.00112613 0.00205106 -1.7207 0.9573506 ## [237,] 0.01569321 -0.00112613 0.03085115 0.0958 0.4618566 ## [238,] 0.10509990 -0.00112613 0.07509636 0.3876 0.3491436 ## [239,] 0.14531222 -0.00112613 0.00851377 1.5871 0.0562493 . ## [240,] 0.13575094 -0.00112613 0.00220933 2.9121 0.0017953 ** ## [241,] -0.10877926 -0.00112613 0.00230041 -2.2445 0.9876006 ## [242,] 0.03921753 -0.00112613 0.02891449 0.2373 0.4062290 ## [243,] 0.07000105 -0.00112613 0.00370503 1.1685 0.1212965 ## [244,] -0.09879376 -0.00112613 0.00266283 -1.8927 0.9708003 ## [245,] 0.03536630 -0.00112613 0.00943459 0.3757 0.3535700 ## [246,] 0.36630339 -0.00112613 0.49419676 0.5227 0.3006034 ## [247,] -0.04230103 -0.00112613 0.07509636 -0.1503 0.5597175 ## [248,] 0.04733533 -0.00112613 0.00195370 1.0964 0.1364524 ## [249,] 0.02574900 -0.00112613 0.02366131 0.1747 0.4306516 ## [250,] -0.06999906 -0.00112613 0.00339902 -1.1813 0.8812646 ## [251,] -0.00551555 -0.00112613 0.01127880 -0.0413 0.5164840 ## [252,] -0.05768381 -0.00112613 0.01724075 -0.4307 0.6666707 ## [253,] 0.03841107 -0.00112613 0.00218732 0.8454 0.1989504 ## [254,] 0.38358417 -0.00112613 0.00235992 7.9193 0.0000000000000011946 *** ## [255,] -0.23628836 -0.00112613 0.01568613 -1.8776 0.9697840 ## [256,] -0.11521278 -0.00112613 0.01127880 -1.0742 0.8586436 ## [257,] -0.10528249 -0.00112613 0.00213354 -2.2549 0.9879315 ## [258,] -0.11006940 -0.00112613 0.00978201 -1.1015 0.8646615 ## [259,] -0.11519139 -0.00112613 0.00270629 -2.1926 0.9858332 ## [260,] -0.07831016 -0.00112613 0.00295612 -1.4196 0.9221380 ## [261,] 0.00195924 -0.00112613 0.00833058 0.0338 0.4865167 ## [262,] 0.09273223 -0.00112613 0.00497359 1.3309 0.0916147 . ## [263,] 0.02532122 -0.00112613 0.00458939 0.3904 0.3481222 ## [264,] 0.03319139 -0.00112613 0.00419362 0.5299 0.2980789 ## [265,] 0.00104064 -0.00112613 0.00597200 0.0280 0.4888158 ## [266,] 0.07361602 -0.00112613 0.04196589 0.3649 0.3576108 ## [267,] 0.00945031 -0.00112613 0.00475783 0.1533 0.4390680 ## [268,] 0.12546086 -0.00112613 0.08144636 0.4436 0.3286801 ## [269,] 0.03047019 -0.00112613 0.00541340 0.4294 0.3338019 ## [270,] -0.08905131 -0.00112613 0.00645812 -1.0941 0.8630461 ## [271,] 0.06565995 -0.00112613 0.00516591 0.9292 0.1763909 ## [272,] -0.23323520 -0.00112613 0.02366131 -1.5089 0.9343433 ## [273,] -0.06514600 -0.00112613 0.00563507 -0.8528 0.8031247 ## [274,] -0.07926686 -0.00112613 0.00563507 -1.0409 0.8510496 ## [275,] 0.14302066 -0.00112613 0.02429631 0.9248 0.1775422 ## [276,] -0.08880677 -0.00112613 0.00282724 -1.6490 0.9504268 ## [277,] -0.02666265 -0.00112613 0.01002663 -0.2550 0.6006484 ## [278,] 0.31657948 -0.00112613 0.00327947 5.5478 0.0000000144622611923 *** ## [279,] -0.04168199 -0.00112613 0.00541340 -0.5512 0.7092559 ## [280,] -0.05070071 -0.00112613 0.00512648 -0.6924 0.7556531 ## [281,] 0.09995779 -0.00112613 0.00541340 1.3739 0.0847403 . ## [282,] -0.11721288 -0.00112613 0.00273582 -2.2194 0.9867708 ## [283,] -0.28035377 -0.00112613 0.04606776 -1.3009 0.9033618 ## [284,] 0.13385775 -0.00112613 0.00607455 1.7319 0.0416450 * ## [285,] 0.09367436 -0.00112613 0.01143554 0.8865 0.1876721 ## [286,] -0.05249051 -0.00112613 0.00572802 -0.6787 0.7513272 ## [287,] 0.03368653 -0.00112613 0.00262035 0.6801 0.2482281 ## [288,] -0.39803007 -0.00112613 0.04842633 -1.8036 0.9643544 ## [289,] 0.03529868 -0.00112613 0.00234786 0.7517 0.2261069 ## [290,] 0.03606735 -0.00112613 0.01210430 0.3381 0.3676580 ## [291,] -0.01744228 -0.00112613 0.00634441 -0.2048 0.5811528 ## [292,] -0.06677818 -0.00112613 0.00413756 -1.0206 0.8462895 ## [293,] 0.07148539 -0.00112613 0.00389932 1.1628 0.1224520 ## [294,] 0.20553723 -0.00112613 0.00350373 3.4914 0.0002403 *** ## [295,] -0.06454698 -0.00112613 0.00462230 -0.9328 0.8245464 ## [296,] -0.00162186 -0.00112613 0.00910867 -0.0052 0.5020722 ## [297,] 0.10170689 -0.00112613 0.03085115 0.5855 0.2791194 ## [298,] -0.18611840 -0.00112613 0.03085115 -1.0532 0.8538792 ## [299,] 0.31171387 -0.00112613 0.00210211 6.8233 0.0000000000044487253 *** ## [300,] -0.02635621 -0.00112613 0.00669629 -0.3083 0.6210805 ## [301,] 0.36630339 -0.00112613 0.32909660 0.6405 0.2609271 ## [302,] 0.03200708 -0.00112613 0.00216559 0.7120 0.2382350 ## [303,] -0.03733075 -0.00112613 0.00452470 -0.5382 0.7047914 ## [304,] 0.01114228 -0.00112613 0.00413756 0.1907 0.4243691 ## [305,] 0.14507262 -0.00112613 0.02305728 0.9628 0.1678220 ## [306,] 0.17951377 -0.00112613 0.08144636 0.6330 0.2633791 ## [307,] 0.02574900 -0.00112613 0.02366131 0.1747 0.4306516 ## [308,] 0.00244835 -0.00112613 0.02429631 0.0229 0.4908522 ## [309,] 0.12546086 -0.00112613 0.08144636 0.4436 0.3286801 ## [310,] -0.19409499 -0.00112613 0.02566928 -1.2044 0.8857877 ## [311,] -0.07424531 -0.00112613 0.00408268 -1.1443 0.8737607 ## [312,] 0.10509990 -0.00112613 0.07509636 0.3876 0.3491436 ## [313,] -0.04171140 -0.00112613 0.03191632 -0.2272 0.5898565 ## [314,] -0.08204414 -0.00112613 0.00204105 -1.7911 0.9633609 ## [315,] 0.11895950 -0.00112613 0.04606776 0.5595 0.2879136 ## [316,] 0.10928468 -0.00112613 0.00212300 2.3963 0.0082813 ** ## [317,] 0.11562685 -0.00112613 0.05716693 0.4883 0.3126652 ## [318,] 0.21768365 -0.00112613 0.00255164 4.3317 0.0000073985306338618 *** ## [319,] 0.13259289 -0.00112613 0.00244683 2.7033 0.0034329 ** ## [320,] 0.01179633 -0.00112613 0.00978201 0.1307 0.4480235 ## [321,] 0.11725057 -0.00112613 0.10896306 0.3586 0.3599421 ## [322,] 0.04033180 -0.00112613 0.00252486 0.8251 0.2046669 ## [323,] 0.03916233 -0.00112613 0.00264856 0.7828 0.2168592 ## [324,] -0.05156259 -0.00112613 0.00458939 -0.7445 0.7717142 ## [325,] 0.03007476 -0.00112613 0.00309375 0.5610 0.2874156 ## [326,] -0.01632211 -0.00112613 0.02429631 -0.0975 0.5388312 ## [327,] 0.10609554 -0.00112613 0.03085115 0.6104 0.2707834 ## [328,] -0.01781902 -0.00112613 0.02429631 -0.1071 0.5426424 ## [329,] -0.01722810 -0.00112613 0.02140994 -0.1100 0.5438133 ## [330,] -0.09447859 -0.00112613 0.00276582 -1.7751 0.9620563 ## [331,] 0.12213601 -0.00112613 0.05103318 0.5456 0.2926579 ## [332,] 0.08965374 -0.00112613 0.01210430 0.8251 0.2046503 ## [333,] -0.00871457 -0.00112613 0.24654652 -0.0153 0.5060967 ## [334,] 0.10969994 -0.00112613 0.00281170 2.0901 0.0183065 * ## [335,] 0.03629533 -0.00112613 0.02193352 0.2527 0.4002587 ## [336,] -0.03360562 -0.00112613 0.00479272 -0.4692 0.6805213 ## [337,] 0.07824567 -0.00112613 0.03699632 0.4127 0.3399298 ## [338,] 0.03629533 -0.00112613 0.02193352 0.2527 0.4002587 ## [339,] 0.15986694 -0.00112613 0.06965349 0.6100 0.2709282 ## [340,] -0.06409081 -0.00112613 0.00344033 -1.0735 0.8584739 ## [341,] -0.10753660 -0.00112613 0.00266283 -2.0621 0.9804016 ## [342,] -0.10603824 -0.00112613 0.14041071 -0.2800 0.6102532 ## [343,] -0.08005588 -0.00112613 0.00263440 -1.5378 0.9379512 ## [344,] 0.03055281 -0.00112613 0.00217642 0.6790 0.2485543 ## [345,] 0.03535648 -0.00112613 0.00232397 0.7568 0.2245903 ## [346,] 0.01572334 -0.00112613 0.00504909 0.2371 0.4062794 ## [347,] -0.00175599 -0.00112613 0.00380025 -0.0102 0.5040761 ## [348,] -0.09239599 -0.00112613 0.00320324 -1.6126 0.9465866 ## [349,] 0.31013283 -0.00112613 0.10896306 0.9429 0.1728568 ## [350,] 0.04087107 -0.00112613 0.00284290 0.7877 0.2154475 ## [351,] -0.01048897 -0.00112613 0.01487372 -0.0768 0.5305972 ## [352,] 0.02971341 -0.00112613 0.01368137 0.2637 0.3960212 ## [353,] 0.47557827 -0.00112613 0.00223164 10.0911 < 0.00000000000000022 *** ## [354,] -0.09196061 -0.00112613 0.00220933 -1.9325 0.9733513 ## [355,] -0.10229599 -0.00112613 0.00297283 -1.8555 0.9682391 ## [356,] 0.07617281 -0.00112613 0.01210430 0.7026 0.2411548 ## [357,] -0.09361651 -0.00112613 0.00284290 -1.7347 0.9585999 ## [358,] 0.04050703 -0.00112613 0.00256518 0.8220 0.2055337 ## [359,] -0.06252675 -0.00112613 0.00932366 -0.6359 0.7375747 ## [360,] -0.11721288 -0.00112613 0.00273582 -2.2194 0.9867708 ## [361,] -0.02151464 -0.00112613 0.00380025 -0.3307 0.6295775 ## [362,] -0.02415767 -0.00112613 0.00628883 -0.2904 0.6142555 ## [363,] 0.07635463 -0.00112613 0.06080884 0.3142 0.3766834 ## [364,] 0.36630339 -0.00112613 0.19701647 0.8278 0.2038933 ## [365,] 0.03912351 -0.00112613 0.00281170 0.7591 0.2239077 ## [366,] 0.09254538 -0.00112613 0.00354699 1.5728 0.0578810 . ## [367,] -0.00975867 -0.00112613 0.00798437 -0.0966 0.5384817 ## [368,] -0.05125280 -0.00112613 0.00433915 -0.7610 0.7766621 ## [369,] 0.01912481 -0.00112613 0.00568122 0.2687 0.3940906 ## [370,] 0.01261276 -0.00112613 0.01112593 0.1303 0.4481836 ## [371,] -0.18761226 -0.00112613 0.02429631 -1.1964 0.8842297 ## [372,] 0.45020694 -0.00112613 0.00352526 7.6015 0.0000000000000146315 *** ## [373,] 0.01095999 -0.00112613 0.02193352 0.0816 0.4674792 ## [374,] 0.02888343 -0.00112613 0.00833058 0.3288 0.3711563 ## [375,] 0.03570246 -0.00112613 0.00285869 0.6888 0.2454703 ## [376,] -0.02544103 -0.00112613 0.00708307 -0.2889 0.6136747 ## [377,] -0.11916628 -0.00112613 0.00389932 -1.8903 0.9706424 ## [378,] 0.03640500 -0.00112613 0.00287460 0.7000 0.2419612 ## [379,] 0.01144625 -0.00112613 0.01690721 0.0967 0.4614863 ## [380,] -0.04120950 -0.00112613 0.00688500 -0.4831 0.6854779 ## [381,] 0.02113542 -0.00112613 0.01083124 0.2139 0.4153114 ## [382,] 0.02516104 -0.00112613 0.01127880 0.2475 0.4022524 ## [383,] -0.10324088 -0.00112613 0.00225425 -2.1507 0.9842515 ## [384,] 0.05013301 -0.00112613 0.00206114 1.1291 0.1294362 ## [385,] -0.37319523 -0.00112613 0.06965349 -1.4098 0.9206981 ## [386,] -0.07884473 -0.00112613 0.00311161 -1.3933 0.9182296 ## [387,] -0.09979949 -0.00112613 0.00259256 -1.9379 0.9736835 ## [388,] -0.07439169 -0.00112613 0.00267720 -1.4160 0.9216103 ## [389,] 0.00876755 -0.00112613 0.00628883 0.1248 0.4503571 ## [390,] 0.03191566 -0.00112613 0.00350373 0.5582 0.2883503 ## [391,] -0.03625355 -0.00112613 0.00486376 -0.5037 0.6927591 ## [392,] 0.44444655 -0.00112613 0.00309375 8.0108 0.0000000000000005698 *** ## [393,] -0.28035377 -0.00112613 0.04606776 -1.3009 0.9033618 ## [394,] -0.09105646 -0.00112613 0.00251162 -1.7944 0.9636287 ## [395,] -0.02762248 -0.00112613 0.00790175 -0.2981 0.6171768 ## [396,] 0.01854307 -0.00112613 0.00860806 0.2120 0.4160539 ## [397,] 0.12546086 -0.00112613 0.08144636 0.4436 0.3286801 ## [398,] -0.12001629 -0.00112613 0.09795638 -0.3799 0.6479773 ## [399,] 0.32375979 -0.00112613 0.00212300 7.0511 0.0000000000008876213 *** ## [400,] 0.28204755 -0.00112613 0.16399644 0.6993 0.2421963 ## [401,] 0.13142336 -0.00112613 0.12272140 0.3784 0.3525775 ## [402,] 0.17284078 -0.00112613 0.00220933 3.7011 0.0001073 *** ## [403,] 0.01184284 -0.00112613 0.08895092 0.0435 0.4826578 ## [404,] -0.08975683 -0.00112613 0.00194429 -2.0100 0.9777863 ## [405,] 0.23991963 -0.00112613 0.12272140 0.6881 0.2457010 ## [406,] 0.25841391 -0.00112613 0.00275076 4.9485 0.0000003738457190282 *** ## [407,] -0.13243864 -0.00112613 0.02566928 -0.8196 0.7937765 ## [408,] -0.10266998 -0.00112613 0.00222045 -2.1549 0.9844164 ## [409,] 0.04526480 -0.00112613 0.00205106 1.0243 0.1528378 ## [410,] 0.03420119 -0.00112613 0.00215484 0.7610 0.2233189 ## [411,] -0.03383309 -0.00112613 0.02429631 -0.2098 0.5831003 ## [412,] 0.02925781 -0.00112613 0.01015311 0.3015 0.3815015 ## [413,] 0.20334152 -0.00112613 0.01246616 1.8313 0.0335283 * ## [414,] -0.05653715 -0.00112613 0.05103318 -0.2453 0.5968819 ## [415,] 0.01228802 -0.00112613 0.00708307 0.1594 0.4366821 ## [416,] -0.05496784 -0.00112613 0.02566928 -0.3361 0.6315858 ## [417,] -0.09087396 -0.00112613 0.00297283 -1.6460 0.9501216 ## [418,] -0.03831423 -0.00112613 0.00425088 -0.5704 0.7157901 ## [419,] 0.04414379 -0.00112613 0.01325282 0.3932 0.3470718 ## [420,] -0.30385250 -0.00112613 0.06965349 -1.1470 0.8743176 ## [421,] -0.04373891 -0.00112613 0.00489993 -0.6088 0.7286578 ## [422,] 0.03796228 -0.00112613 0.00384929 0.6300 0.2643391 ## [423,] -0.10345667 -0.00112613 0.24654652 -0.2061 0.5816395 ## [424,] 0.15986694 -0.00112613 0.06965349 0.6100 0.2709282 ## [425,] -0.06998266 -0.00112613 0.00782062 -0.7786 0.7818977 ## [426,] -0.00756909 -0.00112613 0.00532876 -0.0883 0.5351657 ## [427,] -0.08078727 -0.00112613 0.02248202 -0.5313 0.7023899 ## [428,] 0.06638427 -0.00112613 0.02429631 0.4331 0.3324666 ## [429,] 0.16668391 -0.00112613 0.05716693 0.7019 0.2413857 ## [430,] -0.10020367 -0.00112613 0.00257882 -1.9510 0.9744736 ## [431,] -0.00792787 -0.00112613 0.03191632 -0.0381 0.5151852 ## [432,] -0.12059052 -0.00112613 0.00199191 -2.6767 0.9962827 ## [433,] -0.05785485 -0.00112613 0.00640084 -0.7091 0.7608572 ## [434,] -0.01781902 -0.00112613 0.02429631 -0.1071 0.5426424 ## [435,] -0.09279404 -0.00112613 0.00273582 -1.7526 0.9601614 ## [436,] -0.08771233 -0.00112613 0.00224291 -1.8283 0.9662463 ## [437,] 0.01358684 -0.00112613 0.00860806 0.1586 0.4370000 ## [438,] 0.01040197 -0.00112613 0.00516591 0.1604 0.4362859 ## [439,] 0.01625400 -0.00112613 0.00392472 0.2774 0.3907261 ## [440,] 0.03334279 -0.00112613 0.01597561 0.2727 0.3925386 ## [441,] 0.32348045 -0.00112613 0.00363600 5.3833 0.0000000365746206249 *** ## [442,] 0.01932889 -0.00112613 0.00416544 0.3169 0.3756467 ## [443,] -0.05777784 -0.00112613 0.00602291 -0.7300 0.7672982 ## [444,] -0.07747608 -0.00112613 0.00436922 -1.1551 0.8759684 ## [445,] -0.04685269 -0.00112613 0.00316612 -0.8127 0.7917915 ## [446,] 0.02085584 -0.00112613 0.00657536 0.2711 0.3931625 ## [447,] -0.04396083 -0.00112613 0.00520584 -0.5937 0.7236359 ## [448,] 0.04929349 -0.00112613 0.00395037 0.8022 0.2112197 ## [449,] -0.08807937 -0.00112613 0.00348240 -1.4735 0.9296902 ## [450,] 0.28626595 -0.00112613 0.00235992 5.9160 0.0000000016496535842 *** ## [451,] 0.02355026 -0.00112613 0.00766266 0.2819 0.3890109 ## [452,] -0.01632211 -0.00112613 0.02429631 -0.0975 0.5388312 ## [453,] -0.07971724 -0.00112613 0.00218732 -1.6804 0.9535621 ## [454,] 0.06568776 -0.00112613 0.01068915 0.6462 0.2590614 ## [455,] 0.10170689 -0.00112613 0.03085115 0.5855 0.2791194 ## [456,] -0.01796953 -0.00112613 0.00688500 -0.2030 0.5804292 ## [457,] 0.02936103 -0.00112613 0.00537080 0.4160 0.3387036 ## [458,] -0.04016099 -0.00112613 0.00486376 -0.5597 0.7121629 ## [459,] -0.04589343 -0.00112613 0.00545656 -0.6060 0.7277561 ## [460,] 0.00594199 -0.00112613 0.00824158 0.0779 0.4689708 ## [461,] -0.05044895 -0.00112613 0.00501111 -0.6968 0.7570225 ## [462,] 0.03838738 -0.00112613 0.02366131 0.2569 0.3986366 ## [463,] -0.07981688 -0.00112613 0.00645812 -0.9792 0.8362589 ## [464,] -0.09957458 -0.00112613 0.00225425 -2.0735 0.9809379 ## [465,] -0.09034132 -0.00112613 0.00234786 -1.8412 0.9672045 ## [466,] -0.11622446 -0.00112613 0.00479272 -1.6626 0.9518000 ## [467,] 0.21485816 -0.00112613 0.00214416 4.6644 0.0000015477436183927 *** ## [468,] 0.04912559 -0.00112613 0.00751021 0.5799 0.2810037 ## [469,] 0.15673735 -0.00112613 0.02719917 0.9572 0.1692325 ## [470,] 0.33752018 -0.00112613 0.00213354 7.3315 0.0000000000001137544 *** ## [471,] -0.07433892 -0.00112613 0.04392360 -0.3493 0.6365798 ## [472,] 0.20845583 -0.00112613 0.06080884 0.8499 0.1976889 ## [473,] 0.03627193 -0.00112613 0.00235992 0.7698 0.2206977 ## [474,] 0.09341044 -0.00112613 0.05716693 0.3954 0.3462770 ## [475,] 0.44707106 -0.00112613 0.00231215 9.3210 < 0.00000000000000022 *** ## [476,] 0.03479112 -0.00112613 0.32909660 0.0626 0.4750387 ## [477,] -0.03503773 -0.00112613 0.00419362 -0.5237 0.6997444 ## [478,] -0.08244817 -0.00112613 0.00203110 -1.8044 0.9644190 ## [479,] -0.06017332 -0.00112613 0.00352526 -0.9945 0.8400096 ## [480,] 0.13518354 -0.00112613 0.01143554 1.2747 0.1012127 ## [481,] 0.09187147 -0.00112613 0.01083124 0.8936 0.1857737 ## [482,] 0.02604321 -0.00112613 0.01997290 0.1922 0.4237746 ## [483,] 0.03222952 -0.00112613 0.00218732 0.7132 0.2378599 ## [484,] -0.08327561 -0.00112613 0.03305494 -0.4518 0.6743086 ## [485,] 0.16668391 -0.00112613 0.05716693 0.7019 0.2413857 ## [486,] -0.11280142 -0.00112613 0.00257882 -2.1991 0.9860649 ## [487,] -0.04789219 -0.00112613 0.00497359 -0.6631 0.7463749 ## [488,] 0.01438369 -0.00112613 0.00395037 0.2468 0.4025442 ## [489,] 0.16673152 -0.00112613 0.00207129 3.6883 0.0001129 *** ## [490,] 0.04108371 -0.00112613 0.00405566 0.6628 0.2537293 ## [491,] 0.08121139 -0.00112613 0.01265463 0.7319 0.2321039 ## [492,] 0.25396227 -0.00112613 0.10896306 0.7728 0.2198288 ## [493,] 0.13738586 -0.00112613 0.16399644 0.3420 0.3661624 ## [494,] 0.12917123 -0.00112613 0.00234786 2.6891 0.0035827 ** ## [495,] 0.21464288 -0.00112613 0.09795638 0.6894 0.2452851 ## [496,] -0.09404366 -0.00112613 0.00256518 -1.8346 0.9667168 ## [497,] 0.19779171 -0.00112613 0.10896306 0.6026 0.2733851 ## [498,] -0.03539582 -0.00112613 0.01176123 -0.3160 0.6239978 ## [499,] 0.04805389 -0.00112613 0.01265463 0.4372 0.3309891 ## [500,] -0.18630877 -0.00112613 0.01325282 -1.6086 0.9461473 ## [501,] -0.35696916 -0.00112613 0.07509636 -1.2985 0.9029458 ## [502,] 0.01532308 -0.00112613 0.01346394 0.1418 0.4436341 ## [503,] -0.06920284 -0.00112613 0.00397629 -1.0796 0.8598380 ## [504,] -0.18761226 -0.00112613 0.02429631 -1.1964 0.8842297 ## [505,] -0.11051585 -0.00112613 0.00216559 -2.3506 0.9906297 ## [506,] -0.02783005 -0.00112613 0.01246616 -0.2392 0.5945135 ## [507,] -0.08792814 -0.00112613 0.00247246 -1.7457 0.9595669 ## [508,] 0.31095806 -0.00112613 0.02366131 2.0289 0.0212362 * ## [509,] 0.31277984 -0.00112613 0.00237208 6.4452 0.0000000000577310768 *** ## [510,] -0.03424947 -0.00112613 0.01083124 -0.3183 0.6248598 ## [511,] -0.09785423 -0.00112613 0.03558521 -0.5128 0.6959420 ## [512,] -0.12447195 -0.00112613 0.00230041 -2.5717 0.9949401 ## [513,] -0.11181021 -0.00112613 0.00239664 -2.2609 0.9881177 ## [514,] 0.01738708 -0.00112613 0.00978201 0.1872 0.4257584 ## [515,] -0.11107598 -0.00112613 0.00275076 -2.0964 0.9819753 ## [516,] 0.21464288 -0.00112613 0.09795638 0.6894 0.2452851 ## [517,] -0.04446083 -0.00112613 0.00350373 -0.7321 0.7679463 ## [518,] 0.02574900 -0.00112613 0.02366131 0.1747 0.4306516 ## [519,] -0.25770317 -0.00112613 0.04392360 -1.2242 0.8895704 ## [520,] -0.06693797 -0.00112613 0.00550029 -0.8874 0.8125637 ## [521,] 0.01343041 -0.00112613 0.00504909 0.2049 0.4188418 ## [522,] 0.03473632 -0.00112613 0.00302379 0.6522 0.2571441 ## [523,] 0.03105904 -0.00112613 0.00327947 0.5620 0.2870504 ## [524,] 0.04364871 -0.00112613 0.01346394 0.3859 0.3497942 ## [525,] 0.23116808 -0.00112613 0.00210211 5.0665 0.0000002025694150586 *** ## [526,] -0.09235361 -0.00112613 0.00264856 -1.7726 0.9618559 ## [527,] -0.01454969 -0.00112613 0.00694995 -0.1610 0.5639608 ## [528,] -0.02208255 -0.00112613 0.00335845 -0.3616 0.6411805 ## [529,] -0.05539280 -0.00112613 0.00486376 -0.7781 0.7817512 ## [530,] -0.10080094 -0.00112613 0.09795638 -0.3185 0.6249359 ## [531,] 0.12505364 -0.00112613 0.02803161 0.7536 0.2255318 ## [532,] 0.08366245 -0.00112613 0.01159630 0.7874 0.2155333 ## [533,] 0.12416164 -0.00112613 0.03558521 0.6642 0.2532934 ## [534,] 0.11774304 -0.00112613 0.02891449 0.6991 0.2422588 ## [535,] 0.01291174 -0.00112613 0.00932366 0.1454 0.4422050 ## [536,] 0.12492929 -0.00112613 0.00216559 2.7088 0.0033766 ** ## [537,] 0.01456919 -0.00112613 0.00462230 0.2309 0.4087134 ## [538,] 0.04269662 -0.00112613 0.00252486 0.8721 0.1915688 ## [539,] -0.09112811 -0.00112613 0.00224291 -1.9004 0.9713100 ## [540,] 0.03989809 -0.00112613 0.00253820 0.8143 0.2077403 ## [541,] -0.13318667 -0.00112613 0.00212300 -2.8661 0.9979225 ## [542,] 0.03454988 -0.00112613 0.00344033 0.6082 0.2715134 ## [543,] 0.36630339 -0.00112613 0.49419676 0.5227 0.3006034 ## [544,] -0.02127339 -0.00112613 0.01304773 -0.1764 0.5700022 ## [545,] 0.30311151 -0.00112613 0.12272140 0.8685 0.1925697 ## [546,] -0.09603300 -0.00112613 0.00234786 -1.9587 0.9749245 ## [547,] -0.00774867 -0.00112613 0.00701596 -0.0791 0.5315093 ## [548,] 0.02465823 -0.00112613 0.00307603 0.4649 0.3210011 ## [549,] -0.04900406 -0.00112613 0.00572802 -0.6326 0.7365045 ## [550,] -0.09547972 -0.00112613 0.00239664 -1.9273 0.9730310 ## [551,] -0.18761226 -0.00112613 0.02429631 -1.1964 0.8842297 ## [552,] 0.26519638 -0.00112613 0.09795638 0.8509 0.1974054 ## [553,] 0.09027406 -0.00112613 0.01176123 0.8428 0.1996723 ## [554,] 0.03506189 -0.00112613 0.00314779 0.6450 0.2594626 ## [555,] -0.02891418 -0.00112613 0.01568613 -0.2219 0.5877928 ## [556,] -0.14205642 -0.00112613 0.00199191 -3.1577 0.9992049 ## [557,] -0.02786774 -0.00112613 0.01068915 -0.2587 0.6020482 ## [558,] 0.18770417 -0.00112613 0.00227718 3.9571 0.0000379377193481106 *** ## [559,] -0.07910538 -0.00112613 0.00215484 -1.6799 0.9535071 ## [560,] -0.06318870 -0.00112613 0.02305728 -0.4087 0.6586273 ## [561,] 0.00286752 -0.00112613 0.00462230 0.0587 0.4765793 ## [562,] -0.10160391 -0.00112613 0.00253820 -1.9944 0.9769445 ## [563,] 0.08139537 -0.00112613 0.01325282 0.7168 0.2367411 ## [564,] 0.22849241 -0.00112613 0.02305728 1.5122 0.0652443 . ## [565,] 0.04514649 -0.00112613 0.02566928 0.2888 0.3863621 ## [566,] -0.09822470 -0.00112613 0.00329896 -1.6905 0.9545373 ## [567,] 0.00117653 -0.00112613 0.00504909 0.0324 0.4870742 ## [568,] 0.09059101 -0.00112613 0.02496473 0.5805 0.2807956 ## [569,] 0.02881293 -0.00112613 0.00205106 0.6611 0.2542832 ## [570,] 0.00581861 -0.00112613 0.00824158 0.0765 0.4695114 ## [571,] -0.08053387 -0.00112613 0.00214416 -1.7149 0.9568167 ## [572,] -0.11257756 -0.00112613 0.00230041 -2.3237 0.9899296 ## [573,] 0.04926420 -0.00112613 0.00966369 0.5126 0.3041168 ## [574,] -0.01665070 -0.00112613 0.00479272 -0.2242 0.5887179 ## [575,] -0.01524006 -0.00112613 0.00618011 -0.1795 0.5712413 ## [576,] -0.08031269 -0.00112613 0.00327947 -1.3828 0.9166320 ## [577,] -0.18761226 -0.00112613 0.02429631 -1.1964 0.8842297 ## [578,] 0.03087690 -0.00112613 0.00208150 0.7015 0.2415078 ## [579,] -0.06465046 -0.00112613 0.14041071 -0.1695 0.5673091 ## [580,] 0.03757392 -0.00112613 0.00242156 0.7864 0.2158055 ## [581,] -0.08254817 -0.00112613 0.00212300 -1.7671 0.9613963 ## [582,] -0.04171140 -0.00112613 0.03191632 -0.2272 0.5898565 ## [583,] 0.02997928 -0.00112613 0.02429631 0.1996 0.4209138 ## [584,] 0.00333252 -0.00112613 0.00640084 0.0557 0.4777787 ## [585,] 0.13954185 -0.00112613 0.02366131 0.9145 0.1802314 ## [586,] -0.02757648 -0.00112613 0.00482803 -0.3807 0.6482753 ## [587,] -0.08959294 -0.00112613 0.00257882 -1.7421 0.9592535 ## [588,] -0.01030775 -0.00112613 0.00577546 -0.1208 0.5480818 ## [589,] 0.00647922 -0.00112613 0.00943459 0.0783 0.4687950 ## [590,] -0.05055678 -0.00112613 0.00550029 -0.6665 0.7474559 ## [591,] -0.09697023 -0.00112613 0.00260640 -1.8773 0.9697648 ## [592,] 0.10771683 -0.00112613 0.00223164 2.3040 0.0106105 * ## [593,] -0.03372108 -0.00112613 0.00572802 -0.4307 0.6666472 ## [594,] -0.10105538 -0.00112613 0.00218732 -2.1367 0.9836874 ## [595,] 0.14201385 -0.00112613 0.05103318 0.6336 0.2631617 ## [596,] -0.16991400 -0.00112613 0.02140994 -1.1535 0.8756561 ## [597,] 0.07044677 -0.00112613 0.01143554 0.6693 0.2516523 ## [598,] 0.36630339 -0.00112613 0.49419676 0.5227 0.3006034 ## [599,] -0.09208681 -0.00112613 0.00436922 -1.3761 0.9156056 ## [600,] -0.05966233 -0.00112613 0.02248202 -0.3904 0.6518786 ## [601,] -0.06209741 -0.00112613 0.00433915 -0.9256 0.8226730 ## [602,] -0.02001288 -0.00112613 0.00419362 -0.2917 0.6147231 ## [603,] -0.03236571 -0.00112613 0.00337864 -0.5374 0.7045199 ## [604,] -0.38627512 -0.00112613 0.16399644 -0.9511 0.8292151 ## [605,] 0.01099363 -0.00112613 0.00870421 0.1299 0.4483204 ## [606,] 0.01189586 -0.00112613 0.00320324 0.2301 0.4090142 ## [607,] 0.00226577 -0.00112613 0.00663535 0.0416 0.4833928 ## [608,] 0.08187768 -0.00112613 0.01176123 0.7654 0.2220255 ## [609,] 0.19779171 -0.00112613 0.10896306 0.6026 0.2733851 ## [610,] 0.08432757 -0.00112613 0.00554461 1.1476 0.1255643 ## [611,] -0.09882143 -0.00112613 0.00237208 -2.0059 0.9775665 ## [612,] 0.00806545 -0.00112613 0.00389932 0.1472 0.4414887 ## [613,] -0.00245628 -0.00112613 0.00545656 -0.0180 0.5071834 ## [614,] 0.03057490 -0.00112613 0.00204105 0.7017 0.2414356 ## [615,] 0.04136622 -0.00112613 0.00266283 0.8235 0.2051251 ## [616,] -0.11075454 -0.00112613 0.00504909 -1.5428 0.9385634 ## [617,] 0.00413876 -0.00112613 0.00657536 0.0649 0.4741158 ## [618,] 0.14507262 -0.00112613 0.02305728 0.9628 0.1678220 ## [619,] 0.03248140 -0.00112613 0.01176123 0.3099 0.3783216 ## [620,] 0.00817774 -0.00112613 0.00395037 0.1480 0.4411603 ## [621,] -0.01459101 -0.00112613 0.02366131 -0.0875 0.5348770 ## [622,] 0.03627193 -0.00112613 0.00235992 0.7698 0.2206977 ## [623,] -0.09483992 -0.00112613 0.00220933 -1.9938 0.9769109 ## [624,] -0.08480253 -0.00112613 0.00209177 -1.8296 0.9663419 ## [625,] -0.08610311 -0.00112613 0.00247246 -1.7090 0.9562725 ## [626,] 0.12546086 -0.00112613 0.08144636 0.4436 0.3286801 ## [627,] -0.03755752 -0.00112613 0.00400248 -0.5759 0.7176427 ## [628,] 0.03978806 -0.00112613 0.00202121 0.9101 0.1813963 ## [629,] -0.09667831 -0.00112613 0.00269169 -1.8417 0.9672433 ## [630,] -0.01562250 -0.00112613 0.00554461 -0.1947 0.5771787 ## [631,] -0.02037671 -0.00112613 0.00339902 -0.3302 0.6293728 ## [632,] -0.02081391 -0.00112613 0.00966369 -0.2003 0.5793670 ## [633,] 0.64403885 -0.00112613 0.98949724 0.6486 0.2583050 ## [634,] -0.11570645 -0.00112613 0.03699632 -0.5957 0.7243136 ## [635,] -0.05740682 -0.00112613 0.00363600 -0.9334 0.8246819 ## [636,] 0.04365893 -0.00112613 0.00255164 0.8866 0.1876495 ## [637,] -0.13511161 -0.00112613 0.00207129 -2.9440 0.9983800 ## [638,] -0.07146594 -0.00112613 0.00628883 -0.8870 0.8124565 ## [639,] 0.30311151 -0.00112613 0.12272140 0.8685 0.1925697 ## [640,] 0.03927249 -0.00112613 0.02429631 0.2592 0.3977494 ## [641,] -0.07918103 -0.00112613 0.00217642 -1.6731 0.9528488 ## [642,] -0.00165051 -0.00112613 0.02140994 -0.0036 0.5014297 ## [643,] -0.01807807 -0.00112613 0.00587235 -0.2212 0.5875373 ## [644,] 0.02675573 -0.00112613 0.01513564 0.2266 0.4103550 ## [645,] -0.01747468 -0.00112613 0.00751021 -0.1886 0.5748158 ## [646,] -0.09572909 -0.00112613 0.00295612 -1.7400 0.9590684 ## [647,] -0.12722274 -0.00112613 0.00238432 -2.5824 0.9950940 ## [648,] -0.08401500 -0.00112613 0.00213354 -1.7945 0.9636340 ## [649,] -0.00261624 -0.00112613 0.00966369 -0.0152 0.5060470 ## [650,] 0.01692349 -0.00112613 0.00790175 0.2031 0.4195473 ## [651,] 0.28204755 -0.00112613 0.16399644 0.6993 0.2421963 ## [652,] 0.09288701 -0.00112613 0.03191632 0.5262 0.2993615 ## [653,] -0.08001814 -0.00112613 0.00365879 -1.3043 0.9039276 ## [654,] -0.02004529 -0.00112613 0.00634441 -0.2375 0.5938746 ## [655,] -0.02448643 -0.00112613 0.04196589 -0.1140 0.5453942 ## [656,] 0.04926420 -0.00112613 0.00966369 0.5126 0.3041168 ## [657,] -0.09091364 -0.00112613 0.00452470 -1.3348 0.9090316 ## [658,] 0.03062103 -0.00112613 0.00318460 0.5626 0.2868635 ## [659,] -0.06370037 -0.00112613 0.08144636 -0.2193 0.5867763 ## [660,] -0.13515011 -0.00112613 0.03699632 -0.6968 0.7570336 ## [661,] -0.04803342 -0.00112613 0.00554461 -0.6299 0.7356357 ## [662,] 0.00555550 -0.00112613 0.00335845 0.1153 0.4541054 ## [663,] 0.04221888 -0.00112613 0.00990296 0.4356 0.3315749 ## [664,] 0.13095132 -0.00112613 0.02566928 0.8244 0.2048649 ## [665,] -0.00237677 -0.00112613 0.00356893 -0.0209 0.5083511 ## [666,] 0.03734306 -0.00112613 0.00279629 0.7275 0.2334655 ## [667,] -0.04047135 -0.00112613 0.00365879 -0.6505 0.7423038 ## [668,] 0.01627045 -0.00112613 0.00493653 0.2476 0.4022215 ## [669,] 0.00137744 -0.00112613 0.00900446 0.0264 0.4894758 ## [670,] -0.09415155 -0.00112613 0.00413756 -1.4462 0.9259400 ## [671,] -0.08893687 -0.00112613 0.00324102 -1.5424 0.9385158 ## [672,] -0.01397559 -0.00112613 0.00512648 -0.1795 0.5712130 ## [673,] -0.07581369 -0.00112613 0.00207129 -1.6411 0.9496089 ## [674,] 0.36630339 -0.00112613 0.32909660 0.6405 0.2609271 ## [675,] 0.00892578 -0.00112613 0.00640084 0.1256 0.4500082 ## [676,] 0.04357151 -0.00112613 0.01284841 0.3943 0.3466687 ## [677,] 0.00757576 -0.00112613 0.01997290 0.0616 0.4754513 ## [678,] -0.05085754 -0.00112613 0.00520584 -0.6893 0.7546712 ## [679,] 0.07812692 -0.00112613 0.02305728 0.5219 0.3008597 ## [680,] 0.21911415 -0.00112613 0.03852032 1.1222 0.1308989 ## [681,] -0.00982251 -0.00112613 0.00966369 -0.0885 0.5352461 ## [682,] 0.01730121 -0.00112613 0.00572802 0.2435 0.4038174 ## [683,] -0.03807893 -0.00112613 0.00397629 -0.5860 0.7210671 ## [684,] 0.22843020 -0.00112613 0.08895092 0.7697 0.2207428 ## [685,] 0.06626375 -0.00112613 0.01246616 0.6036 0.2730645 ## [686,] -0.06294985 -0.00112613 0.00572802 -0.8169 0.7929987 ## [687,] -0.01324073 -0.00112613 0.00806852 -0.1349 0.5536423 ## [688,] -0.02953974 -0.00112613 0.00640084 -0.3551 0.6387602 ## [689,] 0.15516699 -0.00112613 0.00278099 2.9637 0.0015196 ** ## [690,] -0.03988416 -0.00112613 0.00344033 -0.6608 0.7456258 ## [691,] -0.11984288 -0.00112613 0.00331861 -2.0608 0.9803385 ## [692,] -0.09419003 -0.00112613 0.00312962 -1.6635 0.9518986 ## [693,] 0.17685989 -0.00112613 0.06080884 0.7218 0.2352161 ## [694,] 0.09141209 -0.00112613 0.03427489 0.4998 0.3085930 ## [695,] -0.02429702 -0.00112613 0.00634441 -0.2909 0.6144370 ## [696,] 0.00951655 -0.00112613 0.00623407 0.1348 0.4463881 ## [697,] 0.11230580 -0.00112613 0.00209177 2.4802 0.0065663 ** ## [698,] -0.09751801 -0.00112613 0.00305847 -1.7430 0.9593300 ## [699,] -0.13082739 -0.00112613 0.01390539 -1.0999 0.8643118 ## [700,] -0.10260709 -0.00112613 0.00257882 -1.9984 0.9771614 ## [701,] 0.03590272 -0.00112613 0.00272100 0.7099 0.2388938 ## [702,] 0.02523775 -0.00112613 0.00462230 0.3878 0.3490912 ## [703,] -0.09191508 -0.00112613 0.00223164 -1.9219 0.9726881 ## [704,] -0.03111644 -0.00112613 0.00729121 -0.3512 0.6372890 ## [705,] 0.04055909 -0.00112613 0.00255164 0.8252 0.2046219 ## [706,] -0.05328188 -0.00112613 0.00558953 -0.6976 0.7572903 ## [707,] -0.08639373 -0.00112613 0.00260640 -1.6702 0.9525582 ## [708,] -0.10948024 -0.00112613 0.00259256 -2.1280 0.9833334 ## [709,] 0.03561278 -0.00112613 0.00239664 0.7505 0.2264903 ## [710,] -0.06016117 -0.00112613 0.02566928 -0.3685 0.6437389 ## [711,] -0.09785423 -0.00112613 0.03558521 -0.5128 0.6959420 ## [712,] 0.08388820 -0.00112613 0.03558521 0.4507 0.3261142 ## [713,] -0.11503069 -0.00112613 0.00329896 -1.9831 0.9763240 ## [714,] -0.10391211 -0.00112613 0.00482803 -1.4793 0.9304666 ## [715,] 0.23523139 -0.00112613 0.00211252 5.1424 0.0000001355995848261 *** ## [716,] -0.06999469 -0.00112613 0.00377609 -1.1207 0.8687979 ## [717,] -0.11063059 -0.00112613 0.00238432 -2.2426 0.9875384 ## [718,] -0.02942400 -0.00112613 0.00348240 -0.4795 0.6842187 ## [719,] 0.05728543 -0.00112613 0.06965349 0.2213 0.4124203 ## [720,] 0.04051542 -0.00112613 0.00245960 0.8396 0.2005542 ## [721,] -0.01847867 -0.00112613 0.00339902 -0.2976 0.6170098 ## [722,] -0.12012362 -0.00112613 0.00196316 -2.6857 0.9963813 ## [723,] 0.03352017 -0.00112613 0.00304106 0.6283 0.2649144 ## [724,] -0.12564699 -0.00112613 0.00225425 -2.6227 0.9956376 ## [725,] 0.03564463 -0.00112613 0.00248542 0.7376 0.2303881 ## [726,] -0.06752467 -0.00112613 0.00413756 -1.0323 0.8490234 ## [727,] -0.08409104 -0.00112613 0.00213354 -1.7962 0.9637651 ## [728,] -0.10682658 -0.00112613 0.00372848 -1.7311 0.9582790 ## [729,] -0.10080094 -0.00112613 0.09795638 -0.3185 0.6249359 ## [730,] 0.09952511 -0.00112613 0.02803161 0.6012 0.2738644 ## [731,] 0.02740327 -0.00112613 0.01513564 0.2319 0.4083096 ## [732,] -0.06241216 -0.00112613 0.00382465 -0.9910 0.8391529 ## [733,] 0.26519638 -0.00112613 0.09795638 0.8509 0.1974054 ## [734,] -0.10367280 -0.00112613 0.02043109 -0.7174 0.7634437 ## [735,] -0.08977246 -0.00112613 0.00219829 -1.8907 0.9706666 ## [736,] 0.21464288 -0.00112613 0.09795638 0.6894 0.2452851 ## [737,] 0.09288701 -0.00112613 0.03191632 0.5262 0.2993615 ## [738,] 0.21464288 -0.00112613 0.09795638 0.6894 0.2452851 ## [739,] -0.04565222 -0.00112613 0.00558953 -0.5956 0.7242660 ## [740,] 0.02937268 -0.00112613 0.01112593 0.2891 0.3862355 ## [741,] 0.05103722 -0.00112613 0.01597561 0.4127 0.3399124 ## [742,] -0.09055702 -0.00112613 0.00231215 -1.8599 0.9685471 ## [743,] 0.04379552 -0.00112613 0.02140994 0.3070 0.3794191 ## [744,] -0.07622674 -0.00112613 0.09795638 -0.2400 0.5948169 ## [745,] -0.09855057 -0.00112613 0.00209177 -2.1302 0.9834205 ## [746,] 0.07130444 -0.00112613 0.02566928 0.4521 0.3256058 ## [747,] 0.10433997 -0.00112613 0.02140994 0.7208 0.2355212 ## [748,] -0.06666825 -0.00112613 0.00524629 -0.9049 0.8172374 ## [749,] 0.01854307 -0.00112613 0.00860806 0.2120 0.4160539 ## [750,] 0.17008836 -0.00112613 0.14041071 0.4569 0.3238642 ## [751,] 0.03033168 -0.00112613 0.00207129 0.6912 0.2447177 ## [752,] 0.18287452 -0.00112613 0.07509636 0.6714 0.2509688 ## [753,] -0.03636629 -0.00112613 0.00623407 -0.4463 0.6723191 ## [754,] 0.14539005 -0.00112613 0.04606776 0.6826 0.2474195 ## [755,] 0.36630339 -0.00112613 0.49419676 0.5227 0.3006034 ## [756,] -0.07430239 -0.00112613 0.08895092 -0.2454 0.5969092 ## [757,] 0.25797445 -0.00112613 0.06965349 0.9817 0.1631137 ## [758,] 0.04910934 -0.00112613 0.00943459 0.5172 0.3025123 ## [759,] -0.11570645 -0.00112613 0.03699632 -0.5957 0.7243136 ## [760,] -0.07770576 -0.00112613 0.00206114 -1.6868 0.9541774 ## [761,] 0.02750181 -0.00112613 0.00640084 0.3578 0.3602368 ## [762,] 0.02574900 -0.00112613 0.02366131 0.1747 0.4306516 ## [763,] 0.03571102 -0.00112613 0.00225425 0.7759 0.2189152 ## [764,] -0.00810341 -0.00112613 0.00657536 -0.0860 0.5342848 ## [765,] 0.02867105 -0.00112613 0.00293955 0.5496 0.2913022 ## [766,] -0.10669014 -0.00112613 0.00255164 -2.0898 0.9816825 ## [767,] -0.02429702 -0.00112613 0.00634441 -0.2909 0.6144370 ## [768,] 0.00014402 -0.00112613 0.02366131 0.0083 0.4967059 ## [769,] -0.00936485 -0.00112613 0.02985256 -0.0477 0.5190158 ## [770,] -0.12330427 -0.00112613 0.00206114 -2.6912 0.9964398 ## [771,] 0.00005195 -0.00112613 0.05716693 0.0049 0.4980343 ## [772,] -0.08424584 -0.00112613 0.16399644 -0.2053 0.5813123 ## [773,] -0.02971090 -0.00112613 0.00582356 -0.3746 0.6460122 ## [774,] 0.10659230 -0.00112613 0.04842633 0.4895 0.3122453 ## [775,] -0.08744121 -0.00112613 0.00276582 -1.6413 0.9496273 ## [776,] -0.02617678 -0.00112613 0.00520584 -0.3472 0.6357776 ## [777,] 0.02997928 -0.00112613 0.02429631 0.1996 0.4209138 ## [778,] 0.02864239 -0.00112613 0.00207129 0.6541 0.2565271 ## [779,] 0.03177292 -0.00112613 0.00715129 0.3890 0.3486243 ## [780,] -0.11347628 -0.00112613 0.00234786 -2.3187 0.9897934 ## [781,] -0.06769520 -0.00112613 0.00402893 -1.0488 0.8528565 ## [782,] 0.12848631 -0.00112613 0.04017132 0.6467 0.2589199 ## [783,] -0.00712678 -0.00112613 0.02496473 -0.0380 0.5151475 ## [784,] -0.08851351 -0.00112613 0.00218732 -1.8685 0.9691537 ## [785,] 0.13738586 -0.00112613 0.16399644 0.3420 0.3661624 ## [786,] -0.03678925 -0.00112613 0.00550029 -0.4809 0.6846951 ## [787,] -0.08492060 -0.00112613 0.00284290 -1.5716 0.9419751 ## [788,] -0.09964728 -0.00112613 0.00715129 -1.1650 0.8779966 ## [789,] -0.08023205 -0.00112613 0.00302379 -1.4386 0.9248649 ## [790,] -0.08366312 -0.00112613 0.00592182 -1.0726 0.8582653 ## [791,] 0.11895950 -0.00112613 0.04606776 0.5595 0.2879136 ## [792,] -0.03488295 -0.00112613 0.00377609 -0.5493 0.7086135 ## [793,] -0.00072994 -0.00112613 0.00341958 0.0068 0.4972971 ## [794,] 0.01218185 -0.00112613 0.00363600 0.2207 0.4126635 ## [795,] 0.16587936 -0.00112613 0.03085115 0.9508 0.1708497 ## [796,] -0.10131418 -0.00112613 0.00233587 -2.0730 0.9809121 ## [797,] 0.05038467 -0.00112613 0.02140994 0.3520 0.3624046 ## [798,] -0.02833783 -0.00112613 0.00774094 -0.3093 0.6214477 ## [799,] -0.05078441 -0.00112613 0.00582356 -0.6507 0.7423879 ## [800,] 0.05159796 -0.00112613 0.01627525 0.4133 0.3397004 ## [801,] -0.06693797 -0.00112613 0.00550029 -0.8874 0.8125637 ## [802,] -0.01524006 -0.00112613 0.00618011 -0.1795 0.5712413 ## [803,] -0.05044694 -0.00112613 0.00475783 -0.7150 0.7627056 ## [804,] -0.11515383 -0.00112613 0.00235992 -2.3473 0.9905440 ## [805,] 0.15322833 -0.00112613 0.04842633 0.7014 0.2415204 ## [806,] 0.11895950 -0.00112613 0.04606776 0.5595 0.2879136 ## [807,] 0.01154473 -0.00112613 0.02366131 0.0824 0.4671749 ## [808,] -0.05936362 -0.00112613 0.00400248 -0.9205 0.8213523 ## [809,] -0.09930092 -0.00112613 0.00245960 -1.9796 0.9761233 ## [810,] 0.07240212 -0.00112613 0.07509636 0.2683 0.3942285 ## [811,] -0.03070760 -0.00112613 0.00322205 -0.5211 0.6988650 ## [812,] -0.09802038 -0.00112613 0.00262035 -1.8929 0.9708118 ## [813,] 0.02272094 -0.00112613 0.00634441 0.2994 0.3823207 ## [814,] -0.02118357 -0.00112613 0.00651629 -0.2485 0.5981149 ## [815,] 0.28204755 -0.00112613 0.16399644 0.6993 0.2421963 ## [816,] -0.05319090 -0.00112613 0.00798437 -0.5827 0.7199428 ## [817,] -0.05802221 -0.00112613 0.00326017 -0.9965 0.8404882 ## [818,] 0.02376798 -0.00112613 0.00978201 0.2517 0.4006366 ## [819,] -0.09830858 -0.00112613 0.00210211 -2.1196 0.9829813 ## [820,] -0.11764759 -0.00112613 0.00326017 -2.0407 0.9793613 ## [821,] -0.09719512 -0.00112613 0.00235992 -1.9776 0.9760120 ## [822,] 0.07034691 -0.00112613 0.01228278 0.6449 0.2594953 ## [823,] 0.03043750 -0.00112613 0.00592182 0.4102 0.3408423 ## [824,] -0.10080094 -0.00112613 0.09795638 -0.3185 0.6249359 ## [825,] -0.00894166 -0.00112613 0.00537080 -0.1066 0.5424645 ## [826,] 0.19779171 -0.00112613 0.10896306 0.6026 0.2733851 ## [827,] -0.08485889 -0.00112613 0.00215484 -1.8038 0.9643685 ## [828,] 0.21464288 -0.00112613 0.09795638 0.6894 0.2452851 ## [829,] -0.07649316 -0.00112613 0.00213354 -1.6317 0.9486249 ## [830,] -0.01251014 -0.00112613 0.00416544 -0.1764 0.5700048 ## [831,] -0.02604552 -0.00112613 0.00427999 -0.3809 0.6483630 ## [832,] -0.04541239 -0.00112613 0.00368180 -0.7299 0.7672619 ## [833,] -0.13923164 -0.00112613 0.16399644 -0.3410 0.6334599 ## [834,] 0.00028769 -0.00112613 0.00870421 0.0152 0.4939546 ## [835,] -0.09602126 -0.00112613 0.00228875 -1.9836 0.9763473 ## [836,] -0.10795554 -0.00112613 0.00302379 -1.9427 0.9739763 ## [837,] 0.09288701 -0.00112613 0.03191632 0.5262 0.2993615 ## [838,] -0.01073747 -0.00112613 0.01284841 -0.0848 0.5337870 ## [839,] 0.12795158 -0.00112613 0.04842633 0.5866 0.2787505 ## [840,] -0.06499924 -0.00112613 0.02248202 -0.4260 0.6649428 ## [841,] -0.09240745 -0.00112613 0.00213354 -1.9762 0.9759340 ## [842,] 0.03927249 -0.00112613 0.02429631 0.2592 0.3977494 ## [843,] -0.09999933 -0.00112613 0.00365879 -1.6346 0.9489329 ## [844,] -0.08177963 -0.00112613 0.00331861 -1.4001 0.9192516 ## [845,] 0.04803847 -0.00112613 0.00339902 0.8433 0.1995337 ## [846,] -0.04562409 -0.00112613 0.00339902 -0.7632 0.7773411 ## [847,] -0.04172931 -0.00112613 0.00607455 -0.5210 0.6988021 ## [848,] -0.11679051 -0.00112613 0.00276582 -2.1993 0.9860723 ## [849,] 0.04244137 -0.00112613 0.04196589 0.2127 0.4157906 ## [850,] 0.03019558 -0.00112613 0.01193051 0.2868 0.3871487 ## [851,] 0.09288701 -0.00112613 0.03191632 0.5262 0.2993615 ## [852,] -0.05312059 -0.00112613 0.00743595 -0.6030 0.7267325 ## [853,] -0.01209037 -0.00112613 0.02641298 -0.0675 0.5268937 ## [854,] 0.14961992 -0.00112613 0.04392360 0.7193 0.2359847 ## [855,] 0.04038858 -0.00112613 0.00416544 0.6432 0.2600349 ## [856,] -0.08402141 -0.00112613 0.00204105 -1.8349 0.9667368 ## [857,] -0.09530448 -0.00112613 0.00249847 -1.8841 0.9702272 ## [858,] -0.91681409 -0.00112613 0.49419676 -1.3026 0.9036374 ## [859,] 0.15318127 -0.00112613 0.04392360 0.7363 0.2307829 ## [860,] 0.36630339 -0.00112613 0.24654652 0.7400 0.2296537 ## [861,] -0.07918103 -0.00112613 0.00217642 -1.6731 0.9528488 ## [862,] -0.08315499 -0.00112613 0.00215484 -1.7671 0.9613936 ## [863,] 0.00487496 -0.00112613 0.01143554 0.0561 0.4776239 ## [864,] 0.16758878 -0.00112613 0.08144636 0.5912 0.2772009 ## [865,] -0.11824289 -0.00112613 0.00344033 -1.9967 0.9770727 ## [866,] -0.00924469 -0.00112613 0.02429631 -0.0521 0.5207693 ## [867,] -0.10948627 -0.00112613 0.00298968 -1.9818 0.9762486 ## [868,] 0.02997928 -0.00112613 0.02429631 0.1996 0.4209138 ## [869,] -0.06688415 -0.00112613 0.00397629 -1.0428 0.8514844 ## [870,] 0.14091058 -0.00112613 0.02496473 0.8990 0.1843388 ## [871,] -0.12295228 -0.00112613 0.00194429 -2.7629 0.9971352 ## [872,] 0.03262840 -0.00112613 0.00210211 0.7362 0.2308002 ## [873,] -0.11447589 -0.00112613 0.00256518 -2.2380 0.9873898 ## [874,] 0.36630339 -0.00112613 0.19701647 0.8278 0.2038933 ## [875,] 0.12309529 -0.00112613 0.01997290 0.8790 0.1897078 ## [876,] -0.09588223 -0.00112613 0.00232397 -1.9656 0.9753268 ## [877,] -0.05288189 -0.00112613 0.00577546 -0.6810 0.7520734 ## [878,] -0.07220040 -0.00112613 0.00766266 -0.8119 0.7915862 ## [879,] -0.10645509 -0.00112613 0.00237208 -2.1626 0.9847154 ## [880,] -0.13481642 -0.00112613 0.00226567 -2.8087 0.9975127 ## [881,] -0.02121280 -0.00112613 0.02366131 -0.1306 0.5519476 ## [882,] -0.04103193 -0.00112613 0.06080884 -0.1618 0.5642792 ## [883,] 0.15391250 -0.00112613 0.02305728 1.0210 0.1536216 ## [884,] -0.02218768 -0.00112613 0.00582356 -0.2760 0.6087227 ## [885,] 0.02997928 -0.00112613 0.02429631 0.1996 0.4209138 ## [886,] -0.05936362 -0.00112613 0.00400248 -0.9205 0.8213523 ## [887,] -0.06693797 -0.00112613 0.00550029 -0.8874 0.8125637 ## [888,] 0.04744826 -0.00112613 0.02366131 0.3158 0.3760838 ## [889,] 0.11895950 -0.00112613 0.04606776 0.5595 0.2879136 ## --- ## Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
Statistical Analyses: LISA
LISA methods allow us to articulate local spatial relationships in the duplicated point areas, based on the intensity of events at the location.
LISAs can help us understant the values (event frequency) of the clustered points related to each other.
Analyses like these provide a more nuanced approach to PSA. They could help determine how much and what kind of sanitary interventions to apply to a certain areas in San Francisco.
Statistical Analyses: LISA
# create vector of logged odds of events
x <- dup_waste$log_odds
# create factor class with two levels.
lhx <- cut(x, breaks=c(min(x), mean(x), max(x)), labels=c("L", "H"),
include.lowest=T)
# lag, based upon weights of the data.
wx <- stats::lag(weights, dup_waste$log_odds)
# create factor class with two levels.
lhwx <- cut(wx, breaks=c(min(wx), mean(wx), max(wx)),
labels=c("L", "H"), include.lowest=T)
# compute a factor interaction
lhlh <- interaction(lhx,lhwx,infl,drop=T)
# add column names to output
names <- rep("none", length(lhlh))
names[lhlh=="L.L.TRUE"]<-"Low with Low"
names[lhlh=="H.L.TRUE"]<-"High with Low"
names[lhlh=="L.H.TRUE"]<-"Low with High"
names[lhlh=="H.H.TRUE"]<-"High with High"
# bind names with coordinate observations
dup_waste_lisa <- as.data.frame(cbind(xy, names))
# filter to remove non-significant points from map
dup_waste_lisa <- dup_waste_lisa %>%
filter(names != "none")
colnames(dup_waste_lisa) <- c("longitude", "latitude", "names")
dup_waste_lisa[c("longitude", "latitude")] <-
lapply(dup_waste_lisa[c("longitude", "latitude")],
function(x) as.numeric(as.character(x)))
Statistical Analyses: LISA
- Map of statistically significant points, with correlation class description. Circa 2020
Conclusion:
Crowdsourcing data from 311 certainly has its limitations, some of which we have been able to address in this case study, others may require increased access, research, understanding, and experimentation.
There is a wealth of availble data with valuable analyses to put together from 311 open data portals.
Conclusion:
Questions, comments, concerns..
Conclusion:
Rpub Link: https://rpubs.com/Averysaurus/spatial_epi_311data
Git Repo Link: https://github.com/Averysaurus/geospatial_casestudy
Feel free to contact me: